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1. Introduction and Preparation 


1.1 Introduction 


In this lab you will use the Kafka Producer node. A complementary lab, 16L18_ 10007, will use the Kafka 
Consumer nodes to receive data produced by the REST API developed in this lab. 


The Kafka Producer and Consumer nodes were introduced in IIB v10.0.0.7. 


1.2 Scenario 

The scenario described in this lab is based on a data replication use case. A primary data source 
(HRDB, relational database) will be updated by an application that is the primary owner of the 
database. Any updates that are made to HRDB will also be propagated to the Kafka server, where 
they will be used to drive the corresponding data updates into any number of target data stores. For 
example, this might include one or more NoSQL databases, or a CRM system such as 
Salesforce.com. 


Data Data 
source target(s) 


Se: Kafka Kafka server 


connector MongoDB 


HRDB DB (IIB) Cloudant 
Salesforce 
etc. 


This lab will extend a partially-built solution of the HR_Service labs developed earlier. In this lab (built 
with IIB 10.0.0.7), the HR_Service scenario has been redesigned to accommodate additional data 
elements. These new elements are contained in a new database table called 
EMPLOYEE_SUPPLEMENTARY, and are described in the Model Definitions section below. 


1.3 Kafka servers 


This lab will investigate two Kafka servers: 


e Chapters 2-4 will investigate the use of locally-installed Kafka servers. Development and testing 
of this lab was done with three Kafka servers installed locally on the IIB workshop Windows 
system. These three servers have configured Kafka replication (replication factor three can be 
used for topics) 


e Chapter 5 will reproduce the same scenario, but using the IBM Bluemix MessageHub service 
instead of the local Kafka servers. MessageHub is IBMs implementation of Kafka on Bluemix. 
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1.3.1 Model Definitions 


The following message models are used by this updated version of the HR_Service REST API. 


DBRESP — contains database response information 
EMPLOYEE - defines columns in the EMPLOYEE table 


EMPLOYEE SUPPLEMENTARY — defines columns in the EMPLOYEE SUPPLEMENTARY 
table 


DEPARTMENT -— defines columns in the DEPARTMENT table 


EmployeeResponse 
o DBResp (type = DBRESP) 
o Employee (Array, type = EMPLOYEE) 


DepartmentResponse 
o DBResp (type = DBRESP) 
o Department (Array, type = DEPARTMENT) 


CompleteResponse 

DBResp_employee (type = DBRESP) 

Employee (type = EMPLOYEE, single object, not array) 
DBResp_department (type = DBRESP) 

Department (type = DEPARTMENT, single object, not array) 
DBResp_employee_supplementary (type = DBRESP) 
Employee_supplementary (type = EMPLOYEE_SUPPLEMENTARY) 


000000 


EmployeeSupplementaryResponse used when only accessing 
EMPLOYEE_SUPPLEMENTARY) 

o DBResp 

o Employee_supplementary 


EmployeeAddUpdateCompleteRequest (input message, used when adding a complete new 
employee) 

o Employee 

o EmployeeSupplementary 
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1.3.2 The HR_Service REST API 


The partially-built solution version of the HR_Service REST API has implemented six operations: 


getEmployee 

getDepartment 

getSupplementary (retrieves data from the EMPLOYEE_SUPPLEMENTARY table) 
getComplete (invokes the getEmployee, getDepartment and getSupplementary operations) 
createEmployeeFromMultipart (adds new employee using a MIME request) 
createEmployeeFromEmbeddedImage (adds a new employee with a plain JSON request) 


The four “get” operations are not used in this lab scenario. The two “create” operations invoke a 
common IIB subflow that performs the database inserts into the EMPLOYEE and 
EMPLOYEE_SUPPLEMENTARY tables. In this lab, you will extend this subflow to publish a 
notification message to the Kafka server when a new employee is added to the EMPLOYEE tables. A 
subsequent IIB application (described in the lab 16L18_ 10007) will consume this message, retrieve 
the new employee data from HRDB, and use this to propagate the update to another database, such 
as a NoSQL database (eg. MongoDB, or Cloudant). 


Topic=employee 


Kafka server 


ublish employee updates 


Request —————————> 
1) Multipart REST (MIME) message 
Part1 - JSON data . 
Part2 - File attachment (image) HR_Service_Complete REST API 


2) JSON message with embedded operation= 
image createMultipartEmployee 


Response «<——______ operation= 


Standard REST message createEmbeddedEmployee 
JSON data 


IIB node 


Insert new record to DB 


HRDB DB 
EMPLOYEE 
EMPLOYEE_ 
SUPPLEMENTARY, 
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1.4 Configure TESTNODE_iibuser for REST APIs 


The instructions in this lab guide are based on a Windows implementation, with a user 
named “iibuser’”. 
The IIB workshop Windows VMWare image on which this lab is based is not available 


outside IBM, so you will need to provide your own software product installations where 
necessary. 


If using the workshop VMWare system, login to Windows as the user "iibuser", password = 
“passwOrd". (You may already be logged in). 


Start the IIB Toolkit from the Start menu. 


The IIB support for the REST API requires some special configuration for the IIB node and server. 
Cross-Origin Resource Scripting (CORS) must be enabled for the IIB node to execute REST 
applications. This is also required when testing with the SwaggerUI test tool. See 


http://www.ws.org/TR/cors/?cm_mc_uid=09173639950214518562833&cm mc sid 50200000=1452 
177651 for further information. 


1. Ensure that TESTNODE iibuser is started. 


2. Check that CORS has been enabled on the IIB node by running the following command in an 
Integration Console: 


mqsireportproperties TESTNODE iibuser 
-e default 
-o HTTPConnector 
-E 


3. If CORS is enabled, you will see the following lines (amongst others): 


corsEnabled='true' 

corsAllowOrigins='*' 

corsAllowCredentials='false' 
corsExposeHeaders='Content-Type' 

corsMaxAge='-1' 
corsAllowMethods='GET,HEAD, POST, PUT, PATCH , DELETE , OPTIONS ' 


corsAllowHeaders='Accept,Accept-Language , Content-Language , Content: 
Type ' 


4. If CORS has not been enabled, run the following commands: 
mqsichangeproperties TESTNODE iibuser 
-e default 
-o HTTPConnector 
-n corsEnabled -v true 


mqsistop TESTNODE iibuser 


mqsistart TESTNODE iibuser 
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1.5 Configure Integration Bus node to work with DB2 


A new database table has been introduced for labs written for IIB 10.0.0.7. 


To run this lab, you should recreate any instances of the HRDB database. Follow the 
instructions below. You may need to alter the database schemas and authorities in the 
DDL to reflect your own environment. 


1.5.1 Create database and tables 
The HRDB database contains three tables: EMPLOYEE, EMPLOYEE_SUPPLEMENTARY and 
DEPARTMENT. These tables have already been created on the supplied workshop VMWare 
image. If you wish to create your own instance of this database (or to recreate on the workshop 
VM), do the following tasks: 


1. Login with a user that has authority to create a new database and tables (on the 
workshop VM, use the user iibadmin (password=passwoOrd). 


2. Open an IIB Command Console (from the Start menu), and navigate to 
c:\student10\Create HR database 


3. Run the commands 
1_Create HRDB database 


2 Create HRDB Tables 
4. Logout user iibadmin (or your own user). 


Appropriate database permissions are included in the scripts to GRANT access to the user 
iibuser. You may need to adjust these to match your own user definitions. 


1.5.2 Create JDBC and security configurable services 
To run this lab, the Integration Bus node must be enabled to allow a JDBC connection to the 
HRDB database. 


1. Login with your standard IIB developer login (iibuser on the workshop VM). 
2. Open an IIB Integration Console (from the Start menu), and navigate to 
c:\student10\Create HR database 


3. Run the command 
A Create JDBC for HRDB 


Accept the defaults presented in the script. This will create the required JDBC 
configurable service for the HRDB database. 


4. Run the command 
4 Create HRDB SecurityID 


5. Stop and restart the node to enable the above definitions to be activated. As an example, 
on the workshop VM: 


mqsistop TESTNODE iibuser 


mqsistart TESTNODE iibuser 
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1.6 Open the Windows Log Monitor for IIB 


A useful tool for IIB development on Windows is the IIB Log Viewer. This tool continuously 
monitors the Windows Event Log, and all messages from the log are displayed immediately. 


From the Start menu, click IIB Event Log Monitor. The Monitor will open; it is useful to have this 
always open in the background. 


EN LIB Event Log Monitor 


< IBI@NODE.serverl > The HTTP Listener has started listening on port d. 
*7?860’’ for ’’http’’ connections. [16/3/2614 3:17:23 PM] 

< IBI@NODE.serverl > Execution group finished with Configuration messa 
ge. [16/3/2614 3:17:24 PM] 

< IBI@NODE.serverl > Configuration message received from broker. [18/3 
/2614 5:67:36 PM] 

< IBI@NODE.serveri > About to ’’Change’’ an execution group. [16/3/2061 
4 5:67:36 PM] 

< IBIG@NODE.serverl > About to ’’create ’’ the deployed resource ’’ Empl 
oyeeService_JSONClient’’ of type ’’.APPZIP’’. (18/3/2614 5:67:37 PM] 

< IBI@NODE.serveri > About to ’’create ’’ the deployed resource ’’ gen. 
getEmployee_EmployeeService_EmpServClient_JSON1’’ of type ’’ .SUBFLOW’. [16/3/26 
14 5:67:37 PM] 

< IBI@NODE.serverl > About to ’’create ’’ the deployed resource ’’ Emp$ 
ervClient_JSON1’’ of type ’’ .MSGFLOW’’. [16/3/2614 5:67:37 PM] 

< IBI@NODE.serverl > Execution group finished with Configuration messa 
ge. [16/3/2614 5:67:43 PM] 

< IBI@NODE.HTTPListener > The HTTP Listener has started listening on p 

t ’’?788@8’’ for ’’http’’ connections. [16/3/2614 5:07:47 PM] 

< IBI@NODE.serveri > Configuration message received from broker. [16/3 
/2614 5:56:41 PM] 

< IBI@NODE.serverl > About to ’’Change’’ an execution group. [16/3/2061 
4 5:56:41 PM] 

< IBI@NODE.serveri > About to ’’delete ’’ the deployed resource ’’ EmpS 


This tool is not shipped as part of the IIB product; please contact us directly if you would like a 
copy. 
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2. Explore and start the Kafka servers 


The supplied VM system that is provided for the V10 workshop labs is supplied with a local installation 
of the Apache Kafka system. For the VM version containing IIB 10.0.0.7, the version of Kafka is 
0.10.1.0 


If you are running the lab scenarios on your own system, you will need to provision your own 
installation of Kafka. Alternatively, the sections of the lab document that reference the IBM Bluemix 
MessageHub Kafka implementation will work as described. 


2.1 Kafka configuration for IIB workshop 

On the workshop VM, Kafka is installed in c:\tools\kafka_2.11-0.10.1.0. In the \bin\windows folder, 
there are a number of “.bat” files that control various aspects of the Kafka system. For ease of use, 
some of these have been copied into the folder c:\student10\kafka\commands. 


On the supplied workshop VM, Kafka has been configured to use a single Zookeeper server and 
three Kafka servers. This enables a topic Replication Factor of three. If you are doing this lab on your 
own system, follow the instructions below to reproduce the same configuration. You will need three 
Kafka servers, and a topic which has a replication factor of three. 


The Kafka servers are shown schematically below. Note that all the servers are defined locally, so all 
have a unique listener port. 


Zookeeper server 


clientPort=2181 


Kafka server Kafka server’ Kafka server2 


broker.id=0 broker.id=1 broker.id=2 
listener=9092 listener=9093 listener=9094 


2.1.1 Kafka installation notes 

The command files in c:\student1 0\kafka\commands have been tailored specifically for this lab and 
the workshop VMWare image. These make the various configuration items easier to achieve in this 
limited test environment. 

If you are running this on your own system, make appropriate changes to these command files. Note 
that each command file sets the java CLASSPATH — make changes as appropriate for your system. 


The Kafka logs have been placed in c:\kafka. This folder is referenced in the various “properties” files, 
described below. 


Set the KAFKA_HOME variable to the install folder of kafka. Append the KAFKA_HOME variable to 
the PATH system environment variable. 


Page 9 of 37 The KafkaProducer node Version 10.0.0.7 
Kafka servers and IBM MessageHub 
Provided by IBM BetaWorks 


IBM Integration Bus V10 Workshop January 2017 


2.2 Explore the Kafka Configuration 
1. In Windows Explorer, navigate to the folder c:\student10\kafka\config. 
2. Open the file zookeeper.properties. 


The data directory folder has been changed for use with the workshop VM system. If you are using 
your own installation, make appropriate changes here. 


#dataDir=/tmp/zookeeper 

dataDir=c://kafka/zookeeper 

# the port at which the clients will connect 

clientPort=2181 

# disable the per-ip limit on the number of connections since this is a non-production config 
maxClientCnxns=0 


Close the file when complete. 
3. Open the file server.properties. 


Most properties have been left at the default values. The following properties have been set as 
follows: 

e Delete.topic.enable=true (allows topics to be removed at server restart) 

e Broker.id=0 

e Listeners=PLAINTEXT://:9092 

e =Log.dirs=c:/kafka/kafka-logs 


If appropriate, make similar changes for your own installation, and save the file. 


# Topic deletion properties 
delete.topic.enable=true 


JHE HHH Server Basics ##HHHEHHHHHHHHHHHHHH 
# The id of the broker. This must be set to a unique integer for each broker. 
broker.id=0 


HHHHHHHHHHHHHHH Socket Server Settings ######HHHHHHHHH 
listeners=PLAINTEXT://:9092 


HEHE HEH Log Basics AHH 
# A comma separated list of directories under which to store log files 
log.dirs=c:/kafka/kafka-logs 


4. Make similar changes to server-1.properties and server-2.properties as necessary, as follows: 


server-1.properties 
e Delete.topic.enable=true 
e Broker.id=1 
e Listeners=PLAINTEXT://:9093 
e ~=Log.dirs=c:/kafka/kafka-logs-1 


server-2.properties 
e Delete.topic.enable=true 
e =Broker.id=2 
e Listeners=PLAINTEXT://:9094 
e =Log.dirs=c:/kafka/kafka-logs-2 
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2.3 Start the Kafka servers 


On the workshop VM system, Windows shortcuts have been provided for the Kafka commands that are 
required to start the various servers. These commands can be run as “iibuser’”. 


1. From the Windows Start menu (or from the desktop), open the folder “Kafka commands) 


A Kafka commands 


> All Programs 


| Search programs and files Val 


The following shortcuts will be available: 


lab |startKafka.cmd 
fai |StartKafka-server 1.cmd 
ab|star tKafka-server2.cmd 


ay |startZookeeper.cmd 


2. Open (run) startZookeeper.cmd. A Windows DOS command window will open and the zookeeper 
server will be started. A significant amount of log output will be produced. 


When started this way, the “startZookeeper.cmd” name will be shown in the title line of the DOS 


window. 
[E startZookeeper-cmd =o) x| 


rg .apache .zookeeper.server.ZooKkeeperServer)> 
[2616-12-14 13:61:56.9771 INFO Server environment: java.io.tmpdir=C:\Users\iibuse 
\ Corg.apache .zookeeper.server.ZooKkeeperServer> 
[2616-12-14 13:61:56,977] INFO Server environment 
-ZooKeeperServer> 


(2616-12-14 13:61:56,977] INFO Server environment :os.name=Windows 7 Corg.apache. 
KeeperServer> 


(2616-12-14 13:61:56,977] INFO Server environment :os.arch=amd64 Corg.apache.zook 


= java.compiler=j?jit26 Corg.apa 


3. Open (run) startKafka.cmd. 
As above, the server will produce some log output. 


t+- startKafka.cmd 


(2616-12-14 13:03:27.633] INFO [LExpirationReaper-@]. Starting Ckafka.server.De (E 
rySExpiredOperat ionReaper> 


(2616-12-14 13:03:27.633] INFO New leader is Ø Ckafka.server.ZookeeperLeaderElec 


ener?) 
[2016-12-14 13:63:27,633] INFO [LExpirationReaper-@]. Starting <kafka.server.Del 
ry$ExpiredOperat ionReaper> 


[2616-12-14 13:63:27,664] INFO [GroupCoordinator Hl: Starting up. Ckafka.coordin 
r) 


4. Repeat with startKafka-server1.cmd and startKafka-server2.cmd. 
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5. Atthis point, all Kafka servers are running, so now create a new topic. 


Open a new DOS window, and change directory to c: \student10\kafka\commands 


6. Run the createTopic.cmd file. 


Provide the following values: 
e Topic: employee 
e Replication factor: 3 
e Partitions 2 


C:\studenti@\Kaf ka\commands >createTopic.cmd 


C:\studenti@\Kafka\commands>echo off 
Enter topic to create (default is employee>: employee 


Enter Replication Factor for employee default is 1>: 3 
Enter number of partitions to create default is 1>: 2 
Created topic "employee". 


7. Run the command file listTopics.cmd. 
The command will return “employee”. 


C:\studenti1@\Kafka\commands>cmd /c “kafka-topics.bat --list --zookeeper localhost:2181" 
employee 


8. Run the command file describeTopic.cmd. 


Provide “employee” as the topic name. The command will return information about the replication 
factor and partitions of the “employee” topic. If you have followed the instructions above, you will 
see output similar to that below. 


C:\student1@6\Kaf ka\commands >describeTopic.cmd 


C:\studenti@\Kafka\commands>echo oft 
Enter topic to describe default is employee>: employee 
Topic:employee PartitionCount :2 ReplicationFactor: 
Topic: employee Partition: @ Leader: 2 Replicas: 
Topic: employee Partition: 1 Leader: Ø Replicas: 


9. Run the command consumeMessages.cmd. 
Specify the “employee” topic, and connect to the Kafka server with port 9092. 


C:\studenti@\Kaf ka\commands >consumeMessages.cmd 


C:\student1@\Kafka\commands>echo off 


Enter topic that you want to consume from (default is employee): employee 
Enter port that you want to connect to Cserver=9692, serverl=9093,. server2=9694,. default is 9@92>: ? 
092 
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10. Open a further DOS windows, and navigate to c:\student10\kafka\commands. 
Run the command produceMessage. cmd. 
Specify the “employee” topic, and connect to Kafka with port 9092. 


Type some text message input, as shown below. Each message is terminated with the Return key. 


C:\studenti@\Kaf ka\commands >produceMessage.cmd 


C:\studenti@\Kafka\commands>echo oft 

Enter topic you want to produce messages to default is employee): employee 

Enter port that you want to connect to Cserver=9092,. server1=98093. server2=9094, default is opgin: 9 
692 


test message 1 


11. Back in the consumeMessages window, observe that the text messages you just produced have 
been consumed by the consumeMessages client application. 


C:\studenti@\Kaf ka\commands >consumeMessages .cmd 


C:\studenti@\Kafka\commands>echo off 
Enter topic that you want to consume from (default is employee): e 
Enter port that you want to connect to Cserver=9692,. serveri=9093. 


892 

test message 1 
test message 2 
final message 


You have now verified that the local Kafka system is configured correctly, and can be used by the 
IIB applications. 
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3. Import and extend the HR_Service REST API 


In this section you will extend the provided REST API, HR_Service. The provided version of 
HR_Service has already implemented the two createEmployee* operations. Both these operations 
use the createEmployeeMain.subflow. This subflow is the component that will be extended in this 
section. 


1. 


If you already have a workspace open, click File, Switch Workspace. Give the new workspace the 
name 


c:\users\iibuser\IBM\IIB 10\workspace kafka 


2. Inthe new workspace, import the Project Interchange file: 
C:\student10\HR_complete\HR_ Service\solution\ 
HR Service Kafka _StartingPoint.10.0.0.7.zip 
Select all three projects from this PI file, and click Finish. 
HR_Service uses the EMPLOYEE, EMPLOYEE_SUPPLEMENTARY and DEPARTMENT tables 
from the HRDB database. This requires the HRDB Database Definition project, which represents 
the tables schemas. This is used by the Mapping nodes that access these tables. The HRDB 
Shared Library and HRDB_ project items contain the database definitions for the DB2 database 
HRDB. 
Note — because the EMPLOYEE_SUPPLEMENTARY table has been added in the 10.0.0.7 version 
of this lab series, the HRDB.dbm file has been updated in this version of the HRDB shared library. 
However, it is backward-compatible with earlier versions, and can be used with earlier lab scenarios 
from this series. 
nlx 
Import Projects N 
Import Projects fr ip file. 2 
mport Pro: ‘om a zip file Se 
From zip file: C:\student10\HR_complete\HR_Service yesources\HR_Service_Kafka_StartingPoint.10.0.0.7.zip el Browse... | 
Project location root: [ C:\Users\ibadmin\IBM\IBT 10 \workspace_kafkal Browse... | 
E HRDB 
LS HRDB_project 
Le HR_Service 
Select All | Deselect All | Select Referenced 
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3. When imported, you will see the HR_Service REST API project, and the HRDB shared library. The 
shared library has a library reference from the HR_Service REST API. 


You will see several subflows are present in HR_Service. This indicates that several operations 
have already been implemented in this REST API. In addition, there are other subflows that are for 
more general use. 


Expanding the REST API Catalog will show the entire list of operations that are defined in this 
REST API. As mentioned above, not all of these operations have been implemented. 


Note that the “HR Employee and Department Services.json” document has been updated to 
Version 4.0.0. This is because new Model Definitions have been provided for the new database 
table, and all “Get” operations have been changed to use the “query parameter” form of a REST 
request with a “get” method. 


Application Development New... 


ZS HR_Service! 


Els createEmployeeFromMultipart.subflow 
i Ea createEmployeefromtEmbeddedimage.subfiow 
le createEmployeeMain.subflow 
Ea getComplete.subfiow 
i Ea getDepartment.subfiow 
i Ela getEmployee.subflow 
El getSupplementary.subflow 
4B Maps 
Zi ESQLs 
(3 REST API Catalog 
=- HR Employee and Department Services 4.0.0 
DT createDepartment 
E createEmployee 
mm createEmployeeFromMultipart 
mm createEmployeefromtEmbeddedimage 
E getComplete 
= getDepartment 
= getDepartments 
= getEmployee 
= getEmployees 
= getSupplementary 
= postEmployee 
= postSupplementary 
+ dE Referenced Libraries 
H-0 Other Resources 
2 HRDB 
=|) Other Resources 
E kn HRDB_project 
ŠT) HRDB.dbm 


It: 


[+ 
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4. Open (double-click) the REST API Description. This will show the Header and Resources 
definitions in the REST API. 


The “get” operations are not described here. If you need information on how to construct these 
operations, please refer to various lab documents earlier in this series, for example 
10006_16L01/02. 


Ki Applic.. 32 (Bä Patter.. = O CS HR Service 52 
Eg Y 
Application Development New... > Header 


~ Resources 


‘4g Subflows > {departments 


A AE 
oad) 


> /departments/department 
(S$ REST API Catalog — — 


zm Ji Referenced Libraries 
)-( Other Resources > /employees 
Gs HRDB 
=)" Other Resources 
a > /employees/complete 
Lg HRDB_project 
> /employees/complete/embeddedimage 
> /employees/complete/ multipart 
> /employees/employee 
> /employees/supplementary 
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5. Further down the HR_Service editor, you will see the supplied Model Definitions. 


Expand the supplied models. These will be used later in the lab. 


~ Model Definitions 


(+) <Enter a unique name to create a new model> 


g 


| 


ISI 
: 
Ñ 


TT? 


{--) EMPLOYEE_SUPPLEMENTARY 
EMPNO_SUPP C string 


E 
3 


| 
ono 


El LA EmployeeSupplementaryResponse object 
DBResp C] DBRESP 
Employee_supplementary IC] EMPLOYEE_SUPPLEMENTARY 
El LA EmployeeAddUpdateCompleteRequest IS object 


6. Expand the /employees/complete/embeddedImage resource. 


You will see a POST operation has been created in this resource. 


Name Parameter type Data type Format Required Description 

Request body Schema type 

[The request body for the operation [JpdateCompleteRequest z] 

Response status Description Arri 

l 200 [The operation was successful. E 
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7. Use the slide bar to move to the right, and open the subflow that implements this operation. 


© 


8. The subflow invokes a further subflow, createEmployeeMain, where the main logic for this 
operation is provided. 


Ea createEmployeefromtEmbeddedimage.subflow 28 


9. Similarly, in the /employees/complete/multipart resource, the createEmployeeFromMultipart 
operation also invokes the same subflow. 


His createEmployeefromtEmbeddedimage.subflow Ea createEmployeeFromMultipart.subflow £3 
| Flow Exerciser: S | QQ 


ka Eley E / 
| BY E 


Reset Content Descriptor MIME domain 
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3.1 Investigate the createEmployeeMain subflow 


1. From either of the two operation subflows mentioned above, open (double-click) the 
createEmployeeMain subflow. 


This subflow is complete, with the exception of a space for a KafkaProducer node. 


However, there are some additional features of some other nodes which will be explored, 
although no further development work is required for these. 


createGeneralDatabaseFailureResponse 


ol 
Write file record if Kafka. fails 


SE 


i et 
äs 
Insert new Employee into database ai E: prepareKafkaMessage Zi | 


Check success, duprec, or, DB failure 
KR createSuccessResponse Output 


createDupRecResponse 


2. Open the “Insert new Employee into database” mapping node. This map accesses three 
database tables, all in the HRDB database, as follows: 


e Select from HRDB(DEPARTMENT) 
e Insert into HRDB(EMPLOYEE) 
e Insert into HRDB(EMPLOYEE_SUPPLEMENTARY) 


If all database operations are successful, all data is placed in the output message assembly, 
with the exception of the binary image element of the input message (see step 6 below). 


[© create_insertNewEmployeeIntoHRDB 


ycreate_insertNewEmployeeIntoHRDB _ 8 Pi p 8%% 0| Eb uaa E 


= Ki Message Assembly JSON k = e Message Assembly 
Fo <Click to filter... > 3 <Click to filter... > 


E of) Properties ..1] PropertiesType Move v e fF] Properties 


@ fF] LocalEnvironment ..1} _LocalEnvironmentType P © ge] JSON 
= df] ISON ..1] JSONMsgType [E] Padding 
[E] Padding ..1] string 3 De Data 
@ [E] DBResp_employee 


“EJ Insert ~ = [E] Employee 


“= Return ~ e [E] DBResp_department 
Failure ~ = [E] Department 


# De Data ..1]  EmployeeAddUpdateCompleteRequest @ [E] DBResp_employee_supplementary 
"By Insert ~ 
"= Return ~ 


Y Failure ~ 


# [€] Employee_supplementary 


ce) B Insert into HRDB/IIBADMIN/EMPLOYEE 
FP <Click to filter...> 


=| 25] Select from HRDB ()—* = Biinsert into HRDB/IIBADMIN/EMPLOYEE_SUPPLEMENTARY 
Fe <Click to filter... > $ <Click to filter...> 


35 r 
I lO ResultSet ..*] Result Set Row Ge EMPNO_SUPP 
E EMAIL 


8 MOBILEPHONE 
B TWITTERID 
8 BOXID 

E IMAGE 
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3. ` Highlight the first Insert transform. The input Data element and the output “Insert into 
HRDB/IIBADMIN/EMPLOYEE?” elements are highlighted. 


If you want to see the precise elements mappings, click the “Insert” text of the transform. 


Return to the highest level of the map when finished. 


=] DE Message Assembly S = [5$ Message Assembly 
FP <Click to filter... > $o <Click to filter... > 


E El Properties ..1] PropertiesType @ fF] Properties 


p = df] ISON 
e gf] Localenvironment ..1] _LocalEnvironmentType E 


S gf] ISON ..1] JSONMsgType [E] Padding 
[E] Padding ..1] string xe Ta Data 
[E] DBResp_employee 


[E] Employee 
[€] DBResp_department 
[E] Department 


EmployeeAddUpdateCompleteRequest [E] DaResp_employee_supplementary 


[E] Employee_supplementary 


“\ ch W Insert into HRDB/IIBADMIN/EMPLOYEE 
> <Click to filter... > 
= [E] Employee ..1] EMPLOYEE 


15 B Insert into HRDB/IIBADMIN/EMPLOYEE_SUPPLE 
Fe <Click to filter... > 

= 26] Select from HRDB RE EMPNo_supp 

FP <Click to filter... > E EMAIL 


e [E] EmployeeSupplementary ..1] EMPLOYEE_SUPPLEMENTARY 


a E ResultSet ..*] Result Set Row P MOBILEPHONE 
§_TWITTERID 


4. Similarly, highlight (click) the second Insert transfom (not the “Insert” text). The same input 
will be highlighted, and the output assemly for the EMPLOYEE_SUPPLEMENTARY table 
will be highlighted. 


Again, if required, click the word “Insert” to see the precise mappings. 


[E] DBResp_employee 


Employee 


DBResp_department 


EmployeeAddUpdateCompleteRequest DBResp_employee_supplementary 


e [E] Department 
e 
e 


& [E] Employee_supplementary 


1E WE Insert into HRDB/IIBADMIN/EMPLOYEE 
Fo <Click to filter... > 
# [E] Employee [0..1] EMPLOYEE 


=| $ Insert into HRDB/TIBADMIN/EMPLOYEE_SUPPLE 
$o <Click to filter... > 

= 5 Select from HRDB 2B EmpNo_supp 

FP <Click to filter... > B EMAIL 


@ [E] EmployeeSupplementary ` D. EMPLOYEE_SUPPLEMENTARY 


+ Ki ResultSet D Result Set Row MOBILEPHONE 
BOXID 


H 

E TWITTERID 
g 

fl IMAGE 


5. Click one of the Return transforms. Note the input and output connections that have been 
made for this transform. 


[E] DBResp_employee 


Employee 


DBResp_department 


Department 


[E 
e 
e 
3 De Data [1..1] EmployeeAddUpdateCompleteRequest [E] DBResp_employee_supplementary 


€) Employee_supplementary 


= $ Insert into HRDB/IIBADMIN/EMPLOYEE 
F <Click to filter... > 

e [E] Employee [0..1] EMPLOYEE 

e [E] EmployeeSupplementary [0..1] EMPLOYEE_SUPPLEMENTARY 


= $ Insert into HRDB/IIBADMIN/EMPLOYEE_SUPPLE 
FÐ <Click to filter... > 
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6. Finally in this map, click the word “Return” to see the precise element mappings. 


Note that the IMAGE element is not mapped. This is because this element will probably be 
quite large, and we don’t want to send this back to the originating client. 


& 
© 7] DBlnsertReturn <Anonymous > = [E} Employee_supplementary EMPLOYEE_SUPPLEN 
FÈ <Click to filter... > Fp <Click to filter... > 
fv g jev [ est 
[E] NumberORowsinserted [1.1] int EMove [E] EMPNO_SUPP 0..1] <string> 
3 [E] EMAIL D. 1 <string> 
3 Èg Data EmployeeAddUpdateCompleteRequest * [E] MOBILEPHONE 0..1} <string> 
Fe <Click to filter... > 2 E twmerRID D. 1 <string> 
Œ [E] Employee nu EMPLOYEE + sox D. <string> 
= [E] EmployeeSupplementary ` D. EMPLOYEE_SUPPLEMENTARY EINA 9 <string> 
€] EMPNO_SUPP D. 0 <string> 
anes = éi DBResp_employee_supplementary DBRESP 
€] EMAIL (0..1] <string> EMove 7 B 
S $o <click to filter... > 
= Move + = 
S MOSILEPHONE D. <string> = " [E] UserReturnCode 0..1] <integer> 
[E] TWITTERID 0..1] <string> “EMove v [E] RowsRetrieved D. 0 <integer> 
Ch 
Te Move + E] RowsAdded 0..1] <integer> 
€] BOXID D. <string> Soe = 
g E] RowsUpdated GË <integer> 
A X 
€] IMAGE D. <string> {l Assign — 
€] RowsDeleted 0..1] <integer> 
[E] SQLCODE_Errorcode o. 0 <integer> 
[E] SQLSTATE_SQLState D. d <string> 


Close the map. 
7. Highlight the “Check success, duprec, or DB failure“ Route node. 


In the properties of this node, the filter pattern has been set to check for successful inserts to 
both the EMPLOYEE and EMPLOYEE_SUPPLEMENTARY tables. If RowsAdded=1 for both 
of these tables, then the message will be sent to the Match terminal, and to the 
KafkaProducer node (to be added). All other responses represent failures of various kinds. 

E Properties £2 E Ki 
"7 Route Node Properties - Check success, duprec, or DB failure 


@, Filter table: Filter pattern: The Data element in XPath $Root/JSON/Data/DBResp_employee/RowsAdded=1 and $Root/JSON/Data/DBResp_employee_supplementary/RowsAdded=1 was r 


Description] found in the XML Schema. 
Basic 4 
— ` neg |__| Fiter pattem 0 Routing output terminal 
- i $Root/JSON/Data/DBResp_employee/RowsAdded=1 and $Root/JSON/Data/DBResp_employee_supplementary/RowsAdded=1 Match 
$Root/JSON/Data/DBResp_employee/SQLSTATE_SQLState=23505 dupRec 


8. Open the prepareKafkaMessage map. 


The output message assembly has a single JSONObject element, employeeAdded. This 
element is set to the value of the employee number (EMPNO), before being published to the 
Kafka server in the subsequent node. Consuming applications will receive this small 
message, and be able to retrieve the full information from the EMPLOYEE and 
EMPLOYEE_SUPPLEMENTARY tables. 


e create_prepareKafkaMessage 
ycreate_prepareKafkaMessage _ 
= DS Message Assembly = [55 Message Assembly 
Fo <Click to filter... > Fp <Click to filter... > 
E afl Properties ..1] PropertiesType " i ge] Properties H PropertiesType 
3 FISON 1] JSONMsgType 3 gf] ISON ..1] JSONMsgType 


[E] Padding EES [E] Padding ..1] string 
=) & choice of cast items 


a De Data ..1] CompleteResponse 
e ee 

= [E] DBResp_employee ..1] DBRESP £l Data ak STE 

= [E] Employee ..1] EMPLOYEE = fig Data eM] JSONObject 


= & choice of cast items 


E any 


Tå employeeAdded 


[E] EMPNO .1] <string> 
[E] FIRSTNME ..1] <string> 
Si MIDINIT ..1] <string> 


€] LASTNAME 1 <string> 


Close the map. 
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9. From the Kafka drawer, drop a KafkaProducer node onto the subflow, name it 
“KafkaProducer Local’, and connect as shown. 


Connect the Failure terminal to the In terminal of the FileOutput node. 


1 


SE, Zeg Sete QatabaceFalureResponse `", 


saVelnEnvironment 
kafkaProducer -Local Wite file record if Kafka fails 
Insert new Employee into database 7B prepareKafkaMessage "Soe 8 | 


createSuccessResponse, Output 


createDupRecResponse 


10. Inthe properties of the KafkaProducer node, set the following properties: 


e Topic: employee 
e Bootstrap server: localhost:9092 
e Acks: 1 


E Properties $3 TE Problems gE Outline $) Tasks Œ Deployment Log 
+6] KafkaProducer Node Properties - KafkaProducer - Local 


| 
dees, 
Basic Topic name* employee 
Security | Bootstrap servers* l localhost:9092 
Validation | e.g. bootstrap.server.com:9092 (multiple servers can be spedfied and delimited using a ,)) 


——— Client ID 
Add IIB suffix to dient ID M 


Acks* Eoo a en a ie ed 
Timeout (sec)* [O00 
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11. 


12. Save the subflow. 


Review the properties of the FileOutput node. 


The properties have been specified to work on a Windows system, and to write an output file 
to the folder c:\kafka\files_noKafka, if the KafkaProducer node should fail. 


If you are running on a non-Windows system, or you want to change the output folder 
destination or file name, make appropriate changes now to these properties. 


E Properties 38 


Os 
oe o7 


Bİ File Output Node Properties - Write file record if Kafka fails 


e 
Directory c: \kafka\files_noKafka 
File name or pattern 
File action 
Mode for writing to file 


@ Write directly to the output file (append if file exists) 
© Stage in mqsitransit directory and move to output directory on "Finish file” 


Action if file exists [Replace Existing File 


Replace duplicate archive files E" 


Action on final file transfer failure [No Action 


Deploy the HRDB Shared Library and then the HR_Service REST API to 
TESTNODE_iibuser/default in the usual way. 
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4. Test the updated HR_Service REST API 
4.1 Using SOAPUI 


1. Open SOAPUI and create a new REST project. 


> New REST Project 


x! 
New REST Project Ca 


Creates a new REST Project in this workspace 


(coed (sence Let 


2. Inthe URI field, specify the following URI, and click OK. 
http: //localhost:7800/HR_Services/resources/employees/complete/embeddedimage 


> New REST Project x| 


New REST Project Oh 
Creates a new REST Project in this workspace 


URI: |'800/HR_Services/resources/employees/complete/embeddedimage 
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3. Change the method to a POST. 


In the input data area, paste the entire contents of the file 


c:\student10\HR_complete\HR_ Service\data\ 
EmbeddedImageWholeMessage.raw. json 


Note that the last data line (highlighted in yellow below) is a binary image of the new 
employee, encoded as a Base64 text encoded string. 
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"Employee" 


"EMPNO": 


=f 


"000015", 


“FIRSTNME": "Albert", 
"MIDINIT": "J", 
“LASTNAME": "Einstein", 
"WORKDEPT": "A00", 
“PHONENO": "5012", 
“HIREDATE": "2016-12-12", 
"JOB": "MGR", 

"“EDLEVEL": 9, 

"SEX": "M", 

"BIRTHDATE": "1875-03-14", 
"SALARY": 20000, 


"BONUS": 
"COMM" = 
WÉI 


5000, 


1024 


"“EmployeeSupplementary"”: { 
"EMPNO SUPP": "000015", 


"EMAIL": 


"BOXID": 
"IMAGE": 


Kafka servers and IBM MessageHub 
Provided by IBM BetaWorks 


"”a.einstein@zurich.com", 
"MOBILEPHONE": "7845364535", 
“TWITTERID": "@EMC2", 


"EMC2@box.com", 


The KafkaProducer node 


Version 10.0.0.7 


IBM Integration Bus V10 Workshop 


January 2017 


4. Change the EMPNO to an employee number that does not already exist in the EMPLOYEE 
table (000028 in this example). 


Click the green arrow to send the request. 
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hd 


Raw | Request 


Method Endpoint 


l 
"er v)so 


"FIRSTNME": "Albert", 
"MIDINIT": "J", 
"LASTNAME": "Einstein", 
"WORKDEPT": "A00", 
"PHONENO": "5012", 
"HIREDATE": "2016-12-12", 
"JOB": "MGR", 

"EDLEVEL": 9, 

SEER: S, 

"BIRTHDATE": "1879-03-14" 
"SALARY": 20000, 

"BONUS": 5000, 

"COMM": 1024 
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5. If successful, the response message will be shown. 


/HR_Services/resources/employees/complete /embeddedimage 


E)<Response xmins="http://localhost/HR_Services/resources/emp 
El <DBResp_department> 
<RowsRetrieved>1</RowsRetrieved> 
<UserReturnCode>0</UserReturnCode> 
</DBResp_ department> 
El <DBResp_employee> 
<RowsAdded>1</RowsAdded> 


<UserReturnCode>0</UserReturnCode> 


| Raw ) HTML) JSON) XML 


</DBResp employee> 


D 


<DBResp employee supplementary> 
<RowsAdded>1</ RowsAdded> 
<UserReturnCode>0</UserReturnCode> 
</DBResp employee supplementary> 
E <Department> 
<ADMRDEPT>A00</ADMRDEPT> 
<DEPTNAME>SPIFFY COMPUTER SERVICE DIV.</DEPTNAME> 
<DEPTNO>A00</ DEPTNO> 
<LOCATION null="true"/> 
<MGRNO>000010</MGERNO> 
</Department> 
= <Employee> 
<BIRTHDATE>1879-03-14</BIRTHDATE> 
<BONUS>5000</BONUS> 
<COMM>1024</COMM> 
<EDLEVEL>9</EDLEVEL> 
<EMPNO>000028</EMPNO> 
<FIRSTNME>Albert</FIRSTNME> 
<HIREDATE>2016-12-12</HIREDATE> 


6. Switch back to the DOS command window which was consuming messages from the Kafka 
employee topic. 


Note that a message has been received with the employee number of the newly added 
employee (000028 in this example). 


C:\studenti1@\Kafka\commands>echo off 
Enter topic that you want to consume from Cdefault is employee): employee 
Enter port that you want to connect to Cserver=9692, serverl=9093. server2 


GKEI 


test message 1 


test message 2 
final message 
<"employeeAdded": "660026 |"? 
<"employeeAdded": "000027"? 
<"employeeAdded": "000028"? 
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4.2 Using Postman 

Although most REST testing tools, such as SOAPUI, are capable of generating and sending a REST 
request with an accompanying JSON payload, not all are capable of sending a MIME request in 
multipart format. The HR_Service REST API has two operations to create anew employee. The second 
of these expects such a message, so this section uses the Chrome Postman tool to send this request. 
Postman is described in more detail in the lab guide 10006_16L15 document. 


1. Open the Postman tool and import the Postman collection “Complete”. This is available in 
the export file 


c:\student10\HR_complete\HR_ Service\postman\ 
Complete.postman_collection.json 


2. Expand Complete, and select the “Add (Complete) — using multipart image” test. 


On the details pane, select the Body tab. The data format will be set to “form-data’. 


Oo Runner Import E) Builder i, KO 


Collections Add (Complete) - using multipart image 


POST 


Choose Files | N 


3. For the employeelmage part of the message, set the attached file to 


c:\student10\HR_complete\HR_service\data\Einstein.jpg 


Set the EMPNO element to an employee value that is not yet in the database. The example 
below shows “000029”. 


Add (Complete) - using multipart image 


http://localhost:7800/HR_Services/resources/employees/complete/multi Params Send ww Save 


employeeData 


Choose Files | Einstein.jpg 


employeelmage 
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4. Click Send. 
The new employee will be added successfully. 


The new employee will be published to Kafka, and the consuming application will receive the 
new notification, as before. 


C:\student1@\Kafka\commands>echo off 
Enter topic that you want to consume from (default is employee): employee 


Enter port that you want to connect to Cserver=9092, serverl1=9093. server2=9694, 
892 


test message 1 
test message 2 


final message 
<"employeefAdded": "968826 "> 
<"employeefAdded 
<"employeeAdded 
<"employeeAdded": "000029"? 
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5. Using the Kafka nodes with IBM MessageHub 
The IIB Kafka Producer and Consumer nodes can also be used with the MessageHub service provided 


on IBM Bluemix. MessageHub is IBMs implementation of Apache Kafka. More information can be found 
here: https://developer.iobm.com/messaging/message-hub/. 


5.1 Explore and configure MessageHub 


1. To use the Bluemix MessageHub service, you will need to login with an IBM ID. If you do not 
have an IBM ID, create one now, and then return to the next step. 


2. Login to the MessageHub service on IBM Bluemix: 


https://console.ng.bluemix.net/catalog/services/message-hub 


When you have logged in, make sure that the Bluemix Region is set to the value that you 
want to use for your own testing. In the example below, the region for the BetaWorks 
organization is “United Kingdom’. 


Account Account 


Region United Kingdom 


Organization BetaWorks 


Space dev 


Manage organizations Create a Space 
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3. In the Bluemix Catalog, type “Message Hub” into the search field. 


Click the Message Hub icon. 


212 Trial Days Remaining w David Hardcastle's Accoun... ted Kingdo etaWorks : de (Q) 


i IBM Bluemix Catalog Catalog Support Account 


All Categories (1) > 


Infrastructure 


Services 


Compute 


Application Services 


Deliver new web and mobile apps. 


Message Hub 


IBM Message Hub 
is a scalable 


IBM 


4. Click Create to create a new Message Hub service. 


Message Hub 


IBM Message Hub is a scalable, Service name: 
high-throughput message bus. Wire 
S Message Hub-a3 
micro-services together using open 
protocols. Connect stream data to 

ý Credential name: 
analytics to realize powerful insights. 
Feed event data to multiple applications Credentials-1 
to react in real time. Bridge to your 


on-premise messaging infrastructure to 


create a hybrid cloud messaging 
SE Features 
IBM s Fast, scalable, fully managed messaging + Streaming analytics integration 
service, based on Apache Kafka Use the power of the Apache Spark and 
Ca ore Message Hub sits on Apache Kafka, an Streaming Analytics services alongside Kafka 
reo: open-source, high-throughput messaging to build high-performance scalable streaming 
system which provides a low-latency analytics solutions. 
Leave unbound platform for handling real-time data feeds. 
e Communication using Kafka, MQ Light or è Connectivity with a range of services 
View Docs REST API clients 


Message Hub will integrate with multiple 
Message Hub provides 3 interfaces services on Bluemix. 

through which messages can be produced 

and consumed. The native Kafka interface 

PUBLISHED 06/23/2016 for Kafka clients, the MQ Light API for MQ 

Light clients, and a REST API. 


AUTHOR IBM 


MIPE Service 


Need Help? 


Contact Bluemix Sales Cost Calculator 


Estimate Monthly Cost 
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5. The new Message Hub service will be created. 


Message Hub-a3 


Manage 


Topics 


| Filter Topics... 


Partitions: 0 used / 0 maximum 


|o e A 


Topic Names Partitions Retention (hours) 


No Topics Found 


6. Create a new topic, by clicking the “Create topic” icon. 


Topics 


| Filter Topics... 


Partitions: 0 used / 100 maximum 


— 


Topic Names Partitions Retention (hours) 


No Topics Found 
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7. Name the new topic “employee” and press Return. 


Topic Names 


| employee] 1 — [24 2 Save Q) 


Partitions Retention (hours) 


No Topics Found 


The new topic will be created with a retention period of 24 hours. 


Topic Names 


8. Click the “Service Credentials” tab. 


Click the “View Credentials” tab. 


Partitions Retention (hours) 


Topic ‘employee’ created. 


Note the server URL values, and the user and password values. These will be used by the 
IIB KafkaProducer node that you update shortly. 


Message Hub-a3 


Service Credentials 


Credentials are provided in JSON format. The JSON 
snippet lists credentials, such as the API key and secret, as 
well as connection information for the service. 


Service Credentials New Credential 


go KEY NAME DATE CREATED ACTIONS 


Credentials-1 Dec 14, 2016 - 05:05:39 View Credentials a 


{ 

"mqlight_lookup_ url": "https://mqlight-lookup-prod02.messagehub.services.eu-gb.bluem 
ix.net/Lookup?serviceId=845afee0-a856-4726-a2c5-af90b2e7ebd7", 

"api_key": "yt3ApcyClTbrdJ7H9nb02Xz466PHOcRvDmNAhhwZ3FdBgJoR1", 

"kafka_admin url": "https: //kafka-admin-prod02.messagehub.services.eu-gb.bluemix.net 
2443", 

"kafka_rest_url": "https: //kafka-rest-prod02.messagehub. services.eu-gb.bluemix.net:4 
43", 


e sasi: 


"kafka01-prod02.messagehub. services.eu-gb.bluemix.net:909 


"kafka02-prodle Messegenue sertteee se go pruemix.net:9093", 
"kafka03-prod02-messagehub. services.eu-gb.bluemix.net:9093", 
"kafka04-prod02.messagehub. services.eu-gb.bluemix.net:9093", 
"kafka05-prod02 pessegebubeservices.eu-gb.bluemix.net:9093" 


"user": "yt3ApcyClTbrg7#9", 
"password": "nb0zXz466PHOcRvDmNAhhwZ3FdBgJoR1” 
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9. Return to the Integration Toolkit, and edit the createEmployeeMain subflow. 


Add a new KafkaProducer node to the flow. Name it “KafkaProducer MessageHub”, and 
connect it as shown. 

Be sure to remove the connection to the KafkaProducer Local node — or you will get logic 
errors at runtime. 


savelnEnvironment ES? = 


, KafkaProducer -Local _ “Write fie record if Kafkè fails 
> = d mE / Teen, \ 
= e P ~ Ep, 
i ‘| a BA 
Insert new Employee into database TA 


prepareKafkaMessage b e Jo = I Y l J 
Check success, duprec, gr DB failure S d — l 


createSuccessResponse Output 


KafkaProducer Messag 


createDupRecResponse 


10. Select the properties of the KafkaProducer MessageHub node. 


On the Basic tab: 
e Topic: employee 


e Bootstrap server: kafka ............... bluemix.net:9093 (copy/paste the first url from 
the Service Credentials from your Bluemix MessageHub service) 
e = =Acks: 1 


E Properties 33 ` 7 Problems f= Outline $ Tasks E Deployment Log 
si KafkaProducer Node Properties - KafkaProducer MessageHub 


eme | 


Basic Topic name* employee 


Security Bootstrap servers* l kafka01-prod02.messagehub.services.eu-gb.bluemix.net:9093 


Validation e.g. bootstrap. server.com:9092 (multiple servers can be specified and delimited using a `? 
itoring Client ID l 


Add IIB suffix to dient ID M 
Acks* ee | 
Timeout (sec)* l 60 


11. On the Security tab, set the security protocol to SASL_SSL. 


E Properties $3 ia Problems JE Outline — Tasks E Deployment Log 
$| KafkaProducer Node Properties - KafkaProducer MessageHub 


Description 
Basic Security protocol* 
Security 


SSL protocol cannot be set if Security protocol is PLAINTEXT or SASL_PLAINTEXT 


Wës SSL protocol* TLSv1.2 
Monitoring 
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12. When connecting to a secure Kafka server, such as MessageHub, the required security 
credentials are provided by the IIB node. Security credentials are created with the 
“mqsisetdbparms” command. 


In an IIB Command Console, run the following command, substituting values for your IIB 
server, username and password as appropriate (user and password are those provided by 
the MessageHub credentials). 


mqsisetdbparms TESTNODE_iibuser 
-n kafka: : KAFKA: :default 
-u yt3ApcyClTbrJ7H9 
-p nb0zXz466PHOcRvDmNAhhwZ3FdBgJoR1 


13. Stop and restart the IIB node. 


14. Save the subflow, and deploy the updated HR_Service in the usual way. 
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5.2 Test HR_Service with MessageHub 


1. Return to the SOAPUI application that was used earlier. Change the EMPNO to a value that 
has not been previously used. 


Click the green arrow to invoke. 


av 
Media Type [applicationfison |») [Post Querys... 


"Employee": { 


"FIRSTNME": "Albert", 
"MIDINIT": "J", 
"LASTNAME": "Einstein", 
"WORKDEPT": "A00", 
“PHONENO": "5012", 
“HIREDATE": "2016-12-12", 
"JOB": "MGR", 

"EDLEVEL": 9, 

"SEX": "M", 

"BIRTHDATE": "1879-03-14", 
"SALARY": 20000, 

"BONUS": 5000, 

"COMM": 1024 
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2. In Bluemix, use the Grafana tools to view activity on the MessageHub system. 


Note that to connect a client directly to the MessageHub system, you can use a variety of 
client tools. In all cases, you will have to configure appropriate security components to 
enable SSL or SASL-style connectivity, which is beyond the scope of this lab. 


Partitions: 1 used / 100 maximum 


[se lee] 


Topic Names Partitions Retention (hours) Metrics & Logs 


Z employee 1 24 Grafana provides metrics, 
dashboards and graphs for 
Message Hub: 


GRAFANA MJ 


END OF LAB GUIDE 
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